D Issertation Process - Based Design of Multimedia Annotation Systems

Annotation of digital multimedia comprises a range of different application scenarios, supported media and annotation formats, and involved techniques. Accordingly, recent annotation environments provide numerous functions and editing options. This results in complexly designed user interfaces, so that human operators are disoriented with respect to task procedures and the selection of accurate tools. In this thesis we contribute to the operability of multimedia annotation systems in several novel ways. We introduce concepts to support annotation processes, at which principles of Workflow Management are transferred. Particularly focusing on the behavior of graphical user interface components, we achieve a significant decrease of user disorientation and processing times. ◦ In three initial studies, we investigate multimedia annotation from two different perspectives. A Feature-oriented Analysis of Annotation Systems describes applied techniques and forms of processed data. Moreover, a conducted Empirical Study and Literature Survey elucidate different practices of annotation, considering case examples and proposed workflow models. ◦ Based on the results of the preliminary studies, we establish a Generic Process Model of Multimedia Annotation, summarizing identified sub-processes and tasks, their sequential procedures, applied services, as well as involved data formats. ◦ By a transfer into a Formal Process Specification we define information entities and their interrelations, constituting a basis for workflow modeling, and declaring types of data which need to be managed and processed by the technical system. ◦ We propose a Reference Architecture Model, which elucidates the structure and behavior of a process-based annotation system, also specifying interactions and interfaces between different integrated components. ◦ As central contribution of this thesis, we introduce a concept for Process-driven User Assistance. This implies visual and interactive access to a given workflow, representation of the workflow progress, and status-dependent invocation of tools. We present results from a User Study conducted by means of the so-called SemAnnot framework. We implemented this novel framework based on our considerations mentioned above. In this study we show that the application of our proposed concept for process-driven user assistance leads to strongly significant improvements of the operability of multimedia annotation systems. These improvements are associated with the partial aspects efficiency, learnability, usability, process overview, and user satisfaction.